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Abstract 


The  usefulness  of  group  theoretic  methods  in  solving  integer  pro- 
gramming (IP)  problems  is  extended  by  procedures  for  controlling  the 
size  of  the  groups.   The  main  procedure  given  shows  how  an  optimal  linear 
programming  basis  can  be  altered  to  reduce  the  magnitude  of  its  deter- 
minant thereby  reducing  the  size  of  the  group  induced  by  the  basis.   An 
adoption  of  Bender's  mixed  IP  algorithm  is  given  which  uses  these  methods. 
Some  limited  computational  experience  is  given. 


535674 


1 .   Introduction 

Computational  experience  with  a  group  theoretic  integer  programming 
(IP)  algorithm  has  been  unusually  promising;  see  reference  6.   A  major 
drawback,  however,  of  this  method  in  the  past  has  been  the  size  of  the 
finite  abelian  groups  encountered  during  the  computation  of  certain  IP 
problems.   In  this  paper,  we  show  how  the  difficulty  can  be  overcome  by 
the  application  of  some  rather  simple  number  theoretic  procedures.   Al- 
though these  procedures  cannot  be  guaranteed  to  reduce  the  size  of  the 
induced  groups,  computational  experience  to  date  has  shown  them  to  be 
efficacious  in  practically  all  cases.   The  central  idea  is  that  a  given 
IP  problem  can  be  usefully  transformed  by  dividing  all  the  coefficients 
of  an  inequality  by  a  rational  divisor  greater  than  1,  and  then  taking 
integer  parts.   Such  a  transformation  of  the  problem,  called  a  relaxation, 
has  the  property  that  all  feasible  solutions  to  the  original  IP  problem 
are  feasible  in  the  transformed  or  relaxed  problem.   The  idea  for  this 
particular  relaxation  method  in  IP  is  originally  due  to  Wolsey  [12].   The 
term  relaxation  is  also  used  by  Geoff rion  in  [3]  to  describe  mathematical 
programming  methods  conceived  in  the  same  spirit  as  the  ones  here. 

The  plan  of  the  paper  is  the  following.   Section  2  consists  mainly 
of  definitions  and  ideas  from  [12]  for  changing  the  coefficients  of  a 
given  IP  problem  by  relaxation  and  other  means.   The  following  section 
demonstrates  that  relaxation  of  constraints  can  be  made  as  required  after 
the  given  IP  problem  is  solved  as  a  linear  programming  (LP)  problem. 
Section  4  is  concerned  with  a  generalized  Lagrange  multiplier  technique  for 
"pricing  out"  the  inaccuracies  introduced  by  the  procedures  of  sections  2 
and  3.   Section  5  contains  an  adaption  of  Bender's  method  [1]  for  mixed  IP 
in  which  group  theoretic  methods  are  used  to  solve  a  series  of  pure  IP 


subproblems.   The  relaxation  procedures  of  the  previous  sections  are 
necessary  for  the  use  of  group  theoretic  methods  on  the  pure  IP  subproblems, 
The  final  section  gives  some  computational  experience. 

2.   Relaxation  and  Restriction  of  IP  Problems 
Consider  the  two  optimization  problems 


and 


min  f(x) 


s.  t .   x  e  X1  , 


min  f(x) 

S  .  t .    X  G  X-, 


(2.1) 


(2.2) 


where  X  and  X  are  subsets  of  E  .   Problem  (2.2)  is  said  to  be  a  relaxation 

(restriction)  of  problem  (2.1)  if  X  XL  X      (X  C  X  ).   Problems  (2.1)  and 

(2.2)  are  equivalent  if  X  =  X  . 

Consider  now  the  IP  problem 

n 
min   E   c.x. 
J-l   J  J 

n 
s.t.    £   a..x.  <  b.        i  =  l,...,m        (2.3) 
J=l 


x.  non-negative  integer,  j  =  l,...,n, 

where  all  the  coefficients  are  integer.   It  is  convenient  to  define  the 

1  x  n  vector  c=  (c.),  the  m  x  n  matrix  A  =  (a,.),  and  the  m  x  1  vector 
3  lj 

b  =  (b±). 

Let  A .  >_   1  be  a  rational  divisor  selected  for  row  i,  i  =  l,...,m. 
It  is  shown  in  [12  ]  that  the  following  problem  is  a  relaxation  of  (2.3) 


min   I   c.x. 
3    J 


j  =  l 

1  Pa.,^     p  b  .^ 

(2.4) 


•c-  aKK -Pil  *  -  * ■ 


x.  non-negative  integer,  j  =  l,...,n, 


where  ft J  is  the  largest  integer  less  than  or  equal  to  t.   The  constructive 
proof  that  (2.4)  is  a  relaxation  of  (2.3)  is  exactly  the  same  as  the 
construction  of  a  Gomory  cut  in  the  all  integer  method  [4]  and  it  will 
therefore  be  omitted. 

It  is  also  possible  to  restrict  problem  (2.3).   Let 


t 


t       if  t  is  integer 

<>    3 

TtTfl   if  t  is  not  integer. 


Then  the  following  problem  is  a  restriction  of  (2.3) 

n 
min      E      c.x. 
J-l     J    J 


S    <7ij>  *      <<~>    -    1  i   =   l,...,m  (2.5) 


x.  non-negative  integer,  j  =  l,...,n. 

If  X.|b.,  then  the  right  hand  side  of  constraint  i  in  (2.5)  can  be 

relaxed      to  <f  bi''Xi^  =  bi/Xi' 

LEMMA  1:   Problem  (2.5)  is  a  restriction  of  problem  (2.3). 

PROOF:   We  want  to  show  that  x' feasible  in  (2.5)  implies  x' feasible  in  (2.3) 


Consider  a  generic  row  i.   Let 


-  a.  . 


C-v 


j  =  1,. ...n, 


and 


b. 

1 

X  . 


<  ^> 


Ai     i 


where  0  <  f..  <  1,  i  =  l,...,n,   0  <  f.  <  1. 
—  ij  —  i 

Then 

n  a. .      b 

I     „j_  x  _  _ 

.  ,  A     J     A  . 

j=l  i   J    i 


n     a. .  d  .  n 

j-1    Ai      J      *i        ±        J-1   1J  J 


n    a.  . 


.I<iii>  x--  <^>  +  l<0, 

J  =  l        1  1 


where  the  first  (strict)  inequality  follows  from  the  properties 


f.  <  1  and  T.      f..x'.  >  0,  for  feasible  x,'  and  the  second  inequality 


J-1 


ij  iJ 


follows  from  the  feasibility  of  x.   This  completes  the  proof, 


The  construction  of  equivalent  IP  problems  with  coefficients  smaller 
in  magnitude  is  very  difficult.   In  fact,  an  equivalent  formulation  of  (2.3) 
with  greatly  reduced  coefficients  will  generally  not  exist.   Nevertheless, 


sufficient  conditions  guaranteeing  equivalence  can  be  stated.   These  conditions 
will  rarely  be  met  but  they  may  prove  useful   in    selecting  the  divisors 
in  the  general  case. 

n  _»  a.  .  b . 

COROLLARY  1:   The  relaxed  constraint   I  |  T^  1  X'^  L  ~)T     I   iS  a" 

j=l  ■»  i  »   J    ■  i" 


equivalent  constraint  if  there  exists  a  6.  such  that 


b 
j  =  1, .  .  .n,  and  C  —±- 


Before  we  discuss  the  details  of  relaxation  and  restriction  of  IP 
problems,  there  are  two  points  to  be  made.   First,  relaxation  or  restriction 
of  a  given  IP  problem  may  not  only  be  desirable  for  reasons  of  efficiency, 
but  it  may  also  be  necessary  if  group  theoretic  methods  are  to  be  applied. 
The  size  of  the  groups  derived  from  (2.3)  are  equal  to  the  magnitude  of 
the  determinants  of  the  m  x  m  non-singular  matrices  (bases)  made  up  of 
the  columns  of  (A, I),  with  particular  interest  focused  on  the  determinant 
of  the  optimal  LP  basis.   Computational  experience  has  indicated  that  IP 
problems  with  basis  determinants  greater  than  100,000  in  magnitude  are  not 
very  amenable  to  computation  using  group  theoretic  methods,  and  determinants 
less  than  10,000  in  magnitude  are  definitely  preferred.   Relaxation  and 
restriction  methods  have  been  seen  in  practice  to  lower  the  magnitude  of 
basis  determinants. 

Second,  our  current  thinking  is  that  relaxation  is  preferred  over 
restriction  because  the  transformation  of  an  IP  problem  to  a  group 
optimization  problem  is  also  a  relaxation.   The  composition  of  two 
relaxation  is,  of  course,  a  relaxation.   Thus,  the  lower  bounds  derived 


from  the  optimal  group  problem  solution  for  the  relaxed  problem  is  a 

lower  bound  on  the  original  problem  as  well.   Moreover,  a  feasible  solution 

to  the  relaxed         problem  is  optimal  in  the  original 

problem  if  it  is  feasible.   Thus,  it  is  only  necessary  to  test  for 

feasibility  in  the  original  problem   those  solutions  derived  from  group 

optimization  problems  that  are  feasible  in  the  relaxed  problem.   The 

remainder  of  the  paper  will  be  concerned  exclusively  with  relaxation 

procedures. 

Finally,  we  remark  that  Kelley's  dual  cutting  plane  algorithm  for  the 
convex  continuous  programming  problem  is  a  relaxation  method  which  converts 
the  convex  problem  to  a  linear  problem  (see  reference  8).   Thus,  it  is 
clear  that  group  theoretic  methods  and  other  IP  relaxation  methods  can  be 
combined  with  Kelley's  algorithm  to  provide  an  algorithm  for  the  convex 
IP  problem.   Kelley  discusses  the  relationship  of  his  algorithm  to  Gomory's 
cutting  plane  algorithm  in  reference  8,  and  we  will  onit  further  details  here, 


3.   Relaxation  of  optimal  bases 

There  is  no  single  objective  criterion  for  selecting  the 

specific  rational  A.  _>  1,  i=l,...,m,  to  use  in  constructing  the  relaxed 

IP  problem  (2.4).   Consequently,  the  procedure  for  determining  the  A. 

must  depend  to  a  certain  extent  on  heuristics  derived  from  computational 
experience.   These  are  discussed  briefly  in  section  6  where  computational 
experience  is  given.   The  task  is  made  easier,  however,  by  the  fact  that 

the  A.  can  be  chosen  after  problem  (2.3)  has  been  solved  as  an  LP;  that  is, 

l 

after  an  m  x  m  optimal  LP  basis  B  made  up  of  m  linearly  independent  columns 
of  (A, I)  has  been  selected.   For  convenience,  assume  (A, I)  =  (N,B)  . 


Let  B  =  (y..),  let  D  =  |det  b|,  and  let  B   =  ((3../D);  where 

v..  and  6,.  are  integers.   Suppose  a  trial  divisor  X      >  1  is  selected  for 

row  r.   The  rationale  for  selecting  X   is  that  the  relaxed  matrix  derived  from 

o   r 

B  be  non-singular.   In  so  doing,  the  search  for  an  optimal  non-basic 
correction  using  group  optimization  problems  (see  [6])  is  unchanged  except 
for  the  coefficients  in  the  canonical  system  over  which  the  search  is  done. 
Thus,  we  require  that  the  matrix 


R  = 


11 


r-1,1 


CM 


r+1,1 


'm,l 


m,m 


be  non-singular.  To  see  what  condition  ensuresthat  |det  R|  f   0, 

notice  that  RB  is  an  identity  matrix  except  for  row  r  which  is  of  the 

form  (£,,...,£  )  where 
1      m 


i=l, . .. ,m. 


(3.2) 


Clearly,  since  det  RB   =  det  R  det  B   =  £  ,  we  have 


Idet  Rl  =  Die  I  =  I  E  fr^  I  B.  I,  (3.3) 


ri  -  Dig  - 1 1  [^]  »Jri 


and  we  require  X   >  1  such  that  E   ^0. 
M      r  —  r 

We  note  in  passing  that  if  the  rcn  slack  variable  is  basic, 


.th 


then  we  must  take  X  =  1  because  y   =3   =1,6.   =  0,  j  ^  r.   The 
r  rr    rr       jr 

inability  to  round  a  row  for  which  the  slack  is  basic  in  consistent  with 

our  goal  of  reducing  the  determinant.   This  is  because  a  unimodular  submatrix 

of  B  has  no  effect  on  the  implied  group  structure  of  B. 

Successive  relaxations  of  B  can  be  performed.   Let  R,  =  (y..) 

be  the  m  x  m  non-singular  matrix  obtained  after  k  iterations  of  the 
relaxation  procedure,  and  let  R,  =/  B .  .  \  ,  where  D.  =  |det  R,  |  .   The  new 


let  rT"  =/B..\,  where  D  =  |det  R^| 


inverse  R,    can  be  computed  from  the  inverse  R^  by  the  rule 


\+l  ~  \     Ek+1 


where  E  is  an  elementary  transformation  matrix.  In  particular,  if 
rounding  row  r  by  X  is  the  (k+l)st  relaxation,  then  E  is  an  m  x  m 
identity  matrix  except  for  row  r  which  is 


<r£"Z -£-!'£•   V5r'   -4l^r—   "V«r> 


where 


k 

y 

C  = 


*  ■  aK]  i 
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Upon  termination  of  the  basis  relaxation  procedure,  it  is  necessary  to 
relax  the  matrix  N  of  non-basic  activities,  and  also  relax  the  right  hand 
side  b.   The  divisors  are,  of  course,  the  same  as  those  used  to  relax  the 
basis,  and  the  relaxations  should  be  done  in  the  same  order. 

We  now  turn  to  a  study  of  the  determinant  of  the  relaxed 
basis  R  as  a  function  of  the  divisor  A  .   Define  the  determinant  function 


m  -»y  . 


t^J 


6(A)  =   S  |  T1  I  TT5"  (3- A) 

3-1 


which  is  the  expression  (3.2)  for  i=r,  where  the  index  r  on  the  coefficients 

Y  . ,  g.   and  \     have  been  suppressed.   Clearly,  6(a)  will  not  in  general  be 

a  monotonic  function  of  A,  and  the  determinant  of  the  relaxed  basis  may 

vary  erratically  as  A  is  increased.   Although  it  is  possible  to  give  some 

results  on  the  behavior  of  6(A),  we  omit  such  an  analysis  because  it  is 

straightforward. 

We  remark  tangentially  that  the  choice  of  a  particular  optimal  LP  basis 

when  there  is  large  scale  LP  degeneracy  should  not  always  be  left  to  the 
simplex  method.   Computational  experience  on  a  limited  number  of  test  prob- 
lems has  suggested  the  following  procedure.   Let  the  simplex  method  find  an 
optimal  solution  and  some  set  of  optimal  LP  reduced  costs.   If  the  optimal 
basis  determinant  is  too  large,  take  the  optimal  basic  activities  which  are 
at  a  positive  level  and  pivot  them  into  an  identity  matrix.   The  result  is  a 
basis  with  many  basic  slacks  and  this  basic  solution  is  the  same  as  the 
previously  obtained  optimal  basic  solution.   The  shadow  prices  relative  to 
this  basis  may  not  be  dual  feasible,  but  the  previously  obtained  optimal  LP 
reduced  costs  are  non-negative  and  represent  a  consistent  set  of  cost  coef- 
ficients to  use  in  the  subsequent  analysis. 


Slack  variable  activities  are  not  relaxed.   This  follows  from  our  discussion 
in  section  2. 


11 

We  cite  the  following  example.   A  scheduling  problem  with  259  rows  was 
found  to  have  an  optimal  basis  determinant  at  the  end  of  the  simplex  method 
of  approximately  103,000.   There  was,  however,  large  scale  degeneracy,  and 
the  procedure  outlined  above  led  to  an  optimal  basis  corresponding  to  the 
same  solution  with  determinant  equal  to  8. 

4.   Relaxation  and  Generalized  Lagrange  Multipliers 

In  this  section,  we  give  a  reformulation  of  the  IP  problem  (2.3). 

The  reformulation  includes  an  identification  of  the  inaccuracies  due  to 

rounding  the  optimal  LP  basis.   As  a  result,  it  is  possible  to  use 

generalized  Lagrange  multipliers  to  "price  out"  the  inaccuracies.   These 

multipliers  can  be  found  by  the  generalized  LP  procedure  of  Brooks  and 

Geoffrion  [2].   The  discussion  of  the  properties  and  algorithmic  uses  of 

the  multipliers  is  brief  in  order  not  to  duplicate  the  discussion  in 

reference  10 about  similar  problems  and  multipliers. 

Recall  that  the  coefficient  matrix  (A, I)  of  (2.3)  is  reordered  and 

partitioned  as  (N,B)  where  B  is  an  optimal  LP  basis  to  (2.3).   Let  (v,y) 

by  the  corresponding  partition  of  the  variables  into  non-basis  and  basic 

variables,  respectively.   Let  the  m  x  m  non-singular  matrix  R  be  a  relaxation 

of  B,  and  let  Q  be  the  corresponding  relaxation  of  N.   Let  q.,  j=l,...,n,  be 

the  columns  of  Q.   Finally,  let  d  be  the  corresponding  relaxation  of  b,  and 

let  g  be  the  canonical  homomorphism  which  maps  the  group  M(I)  onto  the 
K 

factor  group  CK  =  M(I)/M(R). 

The  following  problem  can  easily  be  shown  to  be  equivalent  to  (2.3) 
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min   £   c.v.  (4.1a) 

j-l   J  J 


s.t.       Nv  +  Iy  =  b  (A.  lb) 

Qv  +  Iy  -  d  (4.1c) 


E   PiVi  =  P0  (A. Id) 

j=i  J  J 


v.  non-negative  integer,   j=l,...,n         (4.1e) 
y  1  0  (4. If) 


where  c .  =  c .  -  cDB   a .  >  0,  N  =  B  """N,  b  =  B_Lb,  Q  =  R-1Q,  d  =  R_1d, 
Pj  =  gR(qi)»  j"lf...tn,  PQ  =  8R(d)«  To  see  tnat  problem  (4.1)  is 

equivalent  to  (2.3),  note  that  conditions  (4. Id)  and  (4.1c)  ensure   that 
y  =  d  -  Qv  is  integer.   Condition  (4. If)  ensures  that  y  >  0.   Condition  (4.1b) 
ensures  that  the  non-negative  integer  solution  (v,y)  is  feasible  in  the  original 
problem.   On  the  other  hand,  any  solution  that  is  feasible  in  (2.3)  is 
feasible  in  (4.1). 

It  is  convenient  to  eliminate  explicit  mention  of  y  in  (4.1)  and  hence 
we  rewrite  it  as 

n 
min   £   c.v.  (4.2a) 

j=l   J  ^ 

(N  -  Q)v  =  b  -  d  (4.2b) 

Qv  <  d  (4.2c) 


13 


£  P.v  =  p  (4. 2d) 

j-1  J  J 


v.  non-negative  integer,  (4.2e) 

j-1, . . .,n 


Let  V  =  {v|v  satisfies  (4. 2d),  (4.2e)},  and  let  [V]  denote  the  convex 
hull  of  V;  [V]  is  an  unbounded  convex  polyhedron  with  integer  extreme 
points  and  its  faces  constitute  the  strong  cuts  for  the  rounded  problem 
(see  reference  5) .   Thus  we  consider  the  LP  problem 

min  cv  (4.3a) 

s.t.   (N  -  Q)v  =  b  -  d  (4.3b) 

Qv  <_   d  (4.3c) 

v  e  [V]  (4.3d) 

We  solve  problem  (4.3)  by  generalized  LP  (this  is  the  suggestion  of  Brooks 
and  Geoffrion  [2])  rather  than  generate  all  the  faces  of  [V] .   The  details 
for  doing  this  will  be  omitted  because  they  are  given  for  a  very  similar 
problem  in  reference  10.  We  simply  mention  that  a  gropp  optimization  problem 
defined  over  0\    is  used  to  generate  solutions  for  a  master  LP  problem 
involving  the  constraints  (4.3b)  and  (4.3c).   This  problem  is  of  the  form 


min  (c  +  6°(N  -  Q)  +  tt  Q)v  (4.4) 


s.t.   v  e  V 
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where  0   and  tt  are  the  (generalized)  LP  multipliers  from  the  master.   The 
vector  9   is  unconstrained  in  sign,  and  the  vector  it   >_  0.   Clearly,  9 
"prices  out"  the  inaccuracies  due  to  rounding,  while  tt  "prices  out"  the 
resources  d  available  for  finding  an  optimal  correction  v  in  the  rounded 
problem. 

Let  v  denote  an  optimal  solution  in  (4.4).   The  cut 

(c  +  9°(N  -  Q)  +ti°Q)v  >  (c  +  9°(N  -  Q)  +  tt°Q)v°     (4.5) 


is  a  valid  Gomory  cut  and  can  be  written  with  respect  to  any  multipliers 
6   and  tt   _>  0.   However,  a  particularly  strong  cut  is  obtained  if  9  and  tt 
are  the  optimal  shadow  prices  in  the  LP  problem  (4.3). 


5.   Relaxation  and  Bender's  Method  for  Mixed  Integer  Programming 

In  this  section,  we  exploit  the  relaxation  theory  developed  above  to 
combine  group  theoretic  methods  for  pure  IP  with  Bender's  mixed  IP 
algorithm  [1].   We  assume  that  the  reader  is  familiar  with  Bender's 
algorithm^ and  consequently,  our  development  will  concentrate  on  the 
features  of  the  algorithm  proposed  here  that  are  new. 
The  mixed  IP  problem  is  written  as 

min  cv  +  qw 
s.t.     Av  +  Pw  £  b  (5.1) 

V  >    0,  w  <    W 
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where 


= 4  w|Rw  =  r,  w  non-negative  integer i. 


The  vector  c  is  1  x  n1 ,  the         vector  q  is  1  x  n„,  the  vector  b  is 
m  x  1,  and  the  vector  r  is  m  x  1.   All  coefficients  are  integers. 
Define  the  convex  polyhedron 


U  =  fujuP  £  q,  u  >  oi  (5.2) 

t  s 

and  let  u  ,  t  i    T,  be  the  extreme  points  of  U,  and  let  u  ,  s    S ,  be  a 

complete  set  of  extreme  rays  of  U  satisfying  u  P  •£  0,  u  ^  0.   Bender's 

t  s 

algorithm  assumes  that  u  ,  t  fc  T  ,  u  ,  s  <  S'  are  given  where  T' c  T,  S' 

Bender's  algorithm  begins  with  the  problem 


(5.3a) 


s.t.    w   -  (q  -  utP)w  _£  uS,  t  £  T'  (5.3b) 

-uSPw  >  -uSb,  s  6    S'  (5.3c) 


w   C  W  (5.3d) 


Problem  (5.3)  is  a  mixed  IP  problemwhere  the  continuous  variables  are  w  and 
the  slacks  on  the  constraints  (5.3b)  and  (5.3c).   Our  version  of  the 
algorithm  begins  instead  with  the  following  relaxation  of  (5.3). 


•  t-  w0  -  C(q  "  uCP)}w  >  fufcb3  +  1,  t  <  T' 

"  CuSp]w  Z  -1***1*    s  e  S'  (5. A) 
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w  <  W 


w  integer 


Notice  that  (5.4)  is  now  a  pure  IP  problem  because  w  and  the  slacks 
will  naturally  take  on  integer  values. 

Suppose  (5.4)  is  solved  using  the  IP  algorithm  of  [6]  and  let  w  ,  w 
be  the  optimal  solution.   The  next  step  is  to  solve  the  LP  problem 


min  cv 
s.t.    Av  ±_  b  -  Pw  (5.5) 

v  7  0 

If  (5.5)  has  an  unbounded  solution,  then  (5.1)  has  an  unbounded  solution. 

* 
If  (5.5)  has  a  (bounded)  optimal  solution,  say  v  ,  with  optimal 

* 
dual  variables  u  ,  then  there  are  three  possibilities.   First,  if 

*     *     *         ***  *   * 

wn  —  ^w  +  cv  =  (q  ~  u  P)w  +  u  b,  then  (w  ,v  )  is  an  optimal  solution 

to  (3.1).   On  the  other  hand,  if  w.  <:  (q  -  u  P)w  +  u  b,  then  a  constraint 

is  addfed  to  (5.4)  and  (5.4)  is  reoptimized.   There  are  two  cases  to  consider 

when  a  constraint  is  added.   The  ordinary  case  is  the  addition  of  the 

constraint 


w0  -  C**!  "  u*P)Jw  +  [u*bj  +  1 


*         *   *    * 
to  (5.4).   The  exceptional  case  arises  when  w   z.  (q  -  u  P)w  +  u  b,  but 

w  >   £(q  -  u  P)Jw  +  £u  bj  +  1  implying  that  a  more  restrictive  relaxation 
of  the  desired  constraint  is  required.   We  will  discuss  below  the  steps  to  be 
taken  in  the  latter  case. 


17 


Finally,  it  may  be  that  (5.5)  is  inf^asible,  a  condition  that  implies  the 

s  s       * 

existence  of  an  extreme  ray  u   of  U  with  the  property  that  u  (b  -  Pw  )  ?   0. 

In  this  case,  add  the  constraint 

-  fu  pjw  >  -£u  bj 

to  (5.1)  if  this  constraint  is  binding.   If  this  constraint  is  not  binding^ 

i.e.,  -[u  pjw  ?_  -   £u   b3»  then  once  again  a  more  restrictive  relaxation  of 

s      s 
-u  Pw  -£  u  b  is  required. 


Suppose  now  that  the  relaxed  problem  (5.4)  has  yielded  an  optimal 

*   *  * 

n,  w  such  that  w 


*   *  *         *   *    * 

solution  w  ,  w   such  that  w  -c  (q  -  u  P)w  +  u  b,  but 


wn  ^  C(l  ~  u  P)lw  +  Cu  bl  +  1-   In  this  case»  a  variety  of  options  are  open 
to  us,  and  it  is  difficult  to  anticipate  which  ones  will  be  preferred  for 
computation.   Several  procedures  are  suggested  in  [12].   The  approach  we  take 
here  is  to  give  one  simple  extension,  and  await  further  computational  experience, 
First,  we  drop  all  the  constraints  (5.3b)  in  favor  of  the  single  constraint 


w  £   (q  -  u  P )w  +  u  b.   Since  the  data  must  be  given  in  integers,  we 
'0 


JL  JL  JU  ft         ^  £ 

rewrite  this  as  D  w   >  D  (q  -  uP)w  +  D  u  b,  where  D   is  the  absolute 


value  of  the  determinant  of  the  optimal  LP  basis  in  (5.5)  which  yielded  u  .   Fina 

* 
we  substitute  the  variable  z   for  D  w_;  z_  will  be  an  integer  variable. 

The  second  change  is  to  replace  the  constraints  (5.3c)  by 

-D  u^w  >-D  uSb,  where  D   is  once  again  the  corresponding  magnitude  of 
s     —  s  s 

the  determinant.   (This  change  is,  of  course,  required  when  £u  P^w  -v.  fu  bj, 

s 
but  the  LP  problem  (5.5)  is  infeasible  and  u   is  an  extreme  ray  of  U  with 

s       * 
the  property  u  (b  -  Pw  )  >   0) . 
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(5.6) 


Thus,  problem  (5.3)  becomes 


A         &  ^  jt 

s.t.     z   -  D  (q  -  u  P)w  ^  D  u  b 


-D  u^w  >  -  D  uSb,  s  (-.    S' 


z   integer,  w  e  W 


Problem  (i.6)  is  a  pure  integer  problem.   It  is  solved  first  as  an  LP 
problem,  and  the  optimal  LP  basis  is  examined.   If  the  determinant  is  too 
large  in  magnitude,  then  the  relaxation  procedures  of  section  3  are 

appropriate.   Finally,  the  group  theoretic  methods  are  applied  and  an 

*  * 
optimal  zn,w   obtained.   This  solution  is  tested  as  before  for  optimality 

in  LP  (5.5).   If  a  new  constraint  on  z   is  indicated,  then  the  new 

constraint  should  replace  the  old  one  in  (5.6).   A  test  should  be  made  to 

see  that  no  extreme  point  of  the  polyhedron  U  given  by  (5.2)  is  repeated. 

There  are  many  algorithmic  details  to  be  made  precise  when  the  method 

outlined  above  is  encoded.   As  we  have  said,  some  of  these  will  depend  upon 

computational  experience  not  yet  realized.   There  are,  however,  two  ideas  worth 

discussing.   First,  it  is  important  that  the  first  vector  u  of  shadow  prices 

in  (5.4)  be  meaningful,  and  it  may  be  worthwhile  investing  a  relatively  large 

amount  of  computational  effort  to  obtain  them.   An  obvious  possibility  is  to 

solve  (5.1)  as  an  LP  and  use  the  shadow  prices  on  the  constraints  Av  +  Pw  _>  b 

as  the  first  set  in  (5.4).   For  some  problems,  the  LP  shadow  prices  may  be 

somewhat  inaccurate  in  their  reflection  of  system  economies  and  diseconomies. 
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An  alternative  is  to  use  Gomory's  cutting  plane  method  for  mixed  integer 
programming  until  it  begins  to  slow  down. 

A  second  computational  issue  in  using  Bender's  method  is  how  to 
efficiently  update  the  solution  of  problem  (5.4)  or  problem  (5.6)  when  a  new 
constraint  is  added.   A  number  of  good  suggestions  are  made  in  the  article 
by  Lemke  and  Spilberg  [9].   We  simply  mention  that  it  is  easy  to  add  side 
constraints  to  an  IP  problem  previously  solved  by  group  theoretic  methods. 
In  particular,  the  previously  optimal  LP  basis  for  (5.4)  or  (5.6)  can  be 
used  as  the  dual  feasible  basis  from  which  the  group  problems  are  induced. 

6.   Computational  Experience 

Our  computational  experience  thus  far  with  relaxation  methods  had  been 
with  ad  hoc  procedures  designed  for  specific  applications.   As  such,  the 
experience  is  difficult  to  organize,  but  it  has  been  instructive  and  we  feel 
it  is  worthwhile  discussing  it  here.   The  indication  in  all  cases  is  that 
relaxation  after  obtaining  an  optimal  LP  basis  will  produce  much  better 
procedures . 

One  of  the  first  experiments  with  relaxation  was  on  a  minimal  cost 
scheduling  problem  which  consisted  of  66  rows  and  more  than  400  activities 
(columns).   Due  to  core  storage  limitations  at  the  time  the  problem  was  run, 
it  was  not  possible  to  consider  all  of  the  activities,  and  a  subset  of  176 
plus  a  full  set  of  slacks  was  selected.   Included  were  all  the  columns  of  an 
optimal  LP  basis  which  had  a  determinant  of  4860.   This  determinant  was  not 
too  large  for  computation  with  the  unconstrained  group  algorithm  (see  reference 
6),  but  it  was  decided  that  some  relaxation  was  preferred.   In  particular, 
there  was  a  less  than  or  equal  to  inequality  with  many  non-zero  (integer) 
coefficients  between  13  and  35,  and  a  right  hand  side  of  308. 
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Relaxation  of  the  original  data  (i.e.,  before  rumming  the  simplex 
algorithm)  of  this  single  constraint  using  the  divisor  A  =  2  yielded  an  optimal 
LP  basis  with  a  determinant  of  408,  and  relaxation  with  A  =  4  yielded  a 
determinant  of  66.   The  latter  relaxed  IP  problem  was  solved  in  approximately 
90  seconds  on  a  UNIVAC  1108  computer.   One  feasible  and  nearly  optimal  solution 
to  the  relaxed  problem  used  up  330  units  of  the  relaxed  constraint's  resource, 
and  the  optimal  solution  used  up  341  units.   These  solutions  were  not  entirely 
satisfactory,  but  further  useful  computation  was  not  done. 

A  heuristic  using  generalized  Lagrange  multipliers  was  suggested  for  this 
problem.   The  optimal  LP  shadow  price  on  the  constraint  that  was  relaxed  was 
$3.15,  and  the  total  cost  equal  to  $3.15  x  308  due  to  that  row  was  approxi- 
mately 70%  of  the  minimal  LP  cost  for  the  problem.   The  experience  discussed 
above  indicated  that  this  single  constraint  was  making  the  IP  problem  an 
order  of  magnitude  more  difficult.   Thus,  the  heuristic  of  adding  the  constraint 
to  the  objective  function  with  a  "cost"  of  $3.50,  say,  thereby  eliminating  it 
from  the  problem  would  have  been  a  good  experiement  to  try. 

Another  problem  for  which  relaxation  was  required  was  a  brand  allocation 
problem  which  arises  in  the  scheduling  of  spot  commercials  on  TV.   A  large 
company  buys  many  spots  as  a  package,  and  then  must  decide  how  to  equitably 
and  profitably  allocate  the  spots  to  its  different  brands,  and  it  must  do  this 
subject  to  a  variety  of  logical  constraints.   A  test  problem  consisted  of  86 
constraints  and  148  zero-one  variables.   Additional  upper  bound  constraints 
on  the  variables  were  handled  implicitly.   Most  of  the  constraints  were 
logical  constraints  with  non-zero  coefficients  equal  to  1.   There  were, 
however,  four  constraints  with  large  coefficients  of  three  and  four  place 
integers,  each  required  to  be  satisfied  to  within  5%  of  the  stated  right 
hand  side.   Each  of  these  constraints  was  written  as  a  less  than  or  equal  to 
inequality  with  an  upper  bound  of  10%  on  the  slack  variable. 
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No  relaxation  of  these  four  constraints  was  done  for  the  initial  run, 

39 
and  the  optimal  LP  basis  had  a  determinant  on  the  order  of  10   .   The  constraints 

were  then  rounded  until  all  of  the  non-zero  coefficients  were  one  digit. 

The  determinant  of  the  optimal  basis  of  the  relaxed  problem  was  then  380. 

However,  the  inaccuracies  due  to  relaxation  allowed  one  constraint  to  be 

violated  by  more  than  10%  above  the  target  value,  and  another  was  below  the 

target  value  by  more  than  5%.   We  then  employed  heuristics  to  get  the  solution 

within  plus  or  minus  5%  on  all  four  constraints.   The  heuristics  consisted  of 

small  adjustments  in  the  right  hand  sides  and  reductions  in  the  upper  bounds 

on  the  slacks.   The  results  are  summarized  in  Table  I  below.   The  solution 

for  run  5  satisfied  the  four  relaxed  constraints,  but  an  earlier  solution 

which  slightly  violated  these  constraints  was  preferred. 

Finally,  we  discuss  a  class  of  problems  for  which  relaxation  of  the 
original  data  was  particularly  difficult.   This  is  the  media  selection  problem 
in  which  various  TV  and  radio  programs,  and  magazines  are  selected  for  the 
advertising  campaign  of  a  single  product.   The  objective  function  consists  of 
effectiveness  coefficients  for  each  media  decision  variable.   Included  among 
the  constraints  are  yearly  and  monthly  budget  constraints  whose  coefficients 
were  given  to  four  places.   This  problem  resembles  some  of  the  capital  bud- 
geting problems  discussed  by  Weingartner  in  reference  11. 

There  were  two  difficulties  caused  by  relaxation  of  the  original  data. 
The  first  was  the  disparity  between  the  cost  per  unit  of  the  various  media. 
A  30  second  radio  spot  may  cost  $500,  while  a  60  second  nighttime  network  TV 
spot  may  cost  $50,000.   Sufficient  relaxation  of  a  budget  constraint  with 
coefficients  differing  in  magnitude  by  100  is  impossible  without  eliminating 
the  smaller  coefficients.   A  solution  to  this  difficulty  was  to  aggregate  the 
low  cost  per  unit  media  in  order  to  make  them  more  comparable  on  a  cost  per  unit 
basis . 
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A  second  difficulty  with  relaxation  of  the  original  data  was  the 
inaccuracy   produced  in  the  benefits  per  unit  of  closely  competing 

media.   Relaxation  after  solving  the  LP  is  definitely  preferred  for  these 
problems.   Inaccuracies  in  non-basic  variables  is  a  lower  order  effect  because 
non-basic  variables  are  used  more  sparingly.   One  heuristic  we  used  was  to 
solve  the  original  problem  as  an  LP  and  thereby  identify  the  optimal  basic 
activities.   Accuracy  in  describing  the  activities  of  these  variables  was 
favored  in  subsequent  runs  on  relaxed  data.   Possible  deleterious  effects  of 
inaccuracies  among  the  non-basics  was  reduced  by  placing  tight  upper  bounds 
on  the  non-basics. 

Table  I 
Run  1      Run  2      Run  3      Run  4      Run  5 


D 

380 

168 

380 

200 

280 

Optimal  LP  value 

220983 

224260 

227160 

224985 

220258 

Optimal  IP  value 

219600 

223380 

226280 

224349 

217890 

LP  time 

18.37 

27.08 

18.38 

12.82 

18.38 

Group  representation 

time 

1.58 

1.30 

1.59 

1.52 

1.46 

Unconstrained  group 

optimization  time 

1.40 

0.89 

1.39 

0.95 

1.93 

Search  time 

23.95 

3.17 

2.09 

2.59 

43.08 

Total  run  time 

59.0 

44.0 

35.0 

29.0 

78.0 

Times  are  in  seconds  on  a  UNIVAC  1108  computer. 
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